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Date: 14 June 1995 


A V/. | 

From: Edwin C. May, Ph.D. 
Re: Project Evaluation 


faxed to me new tasking with regard to providing support for the project 
evaluation. Iam asked to find “the 10 primary studies or reports < developed ui^ e 
subject program... that make the best case for establishing the validity of the paranorm 
phenomena known as Remote Viewing.” I am happy to do this as soon as possible. 

I have a concern, however, about a problem that may be raised that could call any results 

into question. . _ . 

Dr. Robert Rosenthal in the Psychology Department at Harvard and °* ers liave defme 
statistical circumstance known as the “file drawer” problem. It is standard Police 
behavioral sciences (including the study of anomalous cognition— remote viewing) to use 
a p=0.05 criteria as a measure of statistical significance. That is, stahstica signi lean 
claimed when, given that the null hypothesis (i.e. no RV in this a 

chance that a repeated experiment of the same number of trials would yield a 
staLtol deviation J iatge as in the original, or larger. We use drat or, ter, on m our 

laboratory. , , 

The file draw problem is this: Under file null hypothesis 5% of the studies will be 
statistically significant. If only the significant studies are published (or in our case given 
to AIR) it is problematical to assess the validity of the research, because it might be tha 
for eve^y study published there are 19 others (in tire file drawer) that dtd no .reach 
statistical significance and were not published. If this were the case, there would be no 
^deice fofan anomaly. Rosenthal and others provide ways of assessing the potential 

magnitude of this problem. 

It might be argued that if I am allowed to pick the best 10 studies, and if it turns out that 
there were 200 others that were not “good,” one could be seriously mislead This is a 
worst case scenario; however, critics would coirectly ^ue tolhere ts^undetemm^ 
file drawer problem with this new approach, and if it is not addressed, file val ty 
evaluation can be questioned. I can assure you that Ray Hyman will raise fins po . 
Might I suggest an alternative that address the concerns of the time constraint, yet avoids 
the 8 file drawer problem. In 1989, SRI published (now downgraded to unclassified) a 
meta-analysis of all the SRI work from 1973 through 1989. This study was part of the 
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